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Abstract 



A global analysis of all the available atmospheric neutrino data is presented 
in terms of neutrino oscillations in the v„ — > v T and v„ — > v s channels, where 
v s denotes a sterile neutrino. We perform our analysis of the contained events 
data as well as the upward-going neutrino-induced muon fluxes. In addition 
to the previous data samples of Frejus, Nusex, 1MB and Kamioka experiments, 
we include the full data set of the 52 kton-yr of Super-Kamiokande, the recent 
4.6 kton-yr contained events of Soudan2 and the results on upgoing muons 
from the MACRO and Baksan detectors. From the statistical analysis it 
emerges that the i/„ — * v T channel provides the best agreement with the 
combined data, with a best fit point of sin 2 (20) = 0.99 and Am 2 = 3.0 x 10 -3 
eV 2 . Although somehow disfavoured, the — > v s channels cannot be ruled 
out on the basis of the global fit to the full set of observables. 
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I. INTRODUCTION 



Together with the solar neutrino problem the atmospheric neutrino anomaly consti- 
tutes the second evidence for physics beyond the Standard Model. Indeed a large number 
of observations |2]-[T2| have been performed concerning electron- and muon-neutrino fluxes 
produced by hadronic showers initiated by cosmic-ray interactions in the upper atmosphere. 
Apart from the first iron-calorimeter detectors |2|,[3[], all experiments, which also entail dif- 
ferent detection techniques, have steadily reported a deficit of the collected number of events 
with respect to the theoretical expectations flT3"| , |l4]| . Although the knowledge of the fluxes 
of atmospheric neutrinos is affected by uncertainties which range from about 20% to 30%, 
the expected ratio R(fi/e) of the muon neutrino {y^ + z/ M ) over the electron neutrino flux 
(z/ e + z/ e ) is known with much better confidence, since the uncertainties associated with the 
absolute fluxes largely cancel out. It is fair to ascribe an overall uncertainty less than about 
5% to the calculated i?(/z/e) ratio. Since this ratio is measured to be substantially smaller 
than the expectations, one faces an anomaly which only seems possible to account for in 
terms of non-standard neutrino properties. 

Super-Kamiokande high statistics observations |§J§ indicate that the deficit in the total 
ratio i?(/i/e) is due to the neutrinos arriving in the detector at large zenith angles. They 
also show that the e-like events do not present any compelling evidence of a zenith-angle 
dependent suppression, while the /^-like event rates are substantially suppressed at large 
angles. Different explanations to these features have been proposed and discussed in the 
literature |K|,|n]]. The simplest and most direct possibility is represented by the oscillation of 



muon neutrinos into either a v T or a sterile neutrino v s |l7|-|T9|j. The oscillation hypothesis 
provides a very good explanation for this smaller-than-expected ratio, which is also simple 
and well-motivated theoretically. 

In this paper we present our updated analysis of all the available data on atmospheric 
neutrinos in terms of neutrino oscillation. We include in the analysis all the existing ex- 
perimental results obtained so far. In addition to the previous data samples of Frejus 0, 
Nusex ||, 1MB M and Kamioka [0] experiments, we also consider the recent Soudan2 |3j 
data which refers to an exposure of 4.6 kton-yr, the full data set of the 52 kton-yr of Super- 



Kamiokande [IIUJ, including both contained events and upgoing muon data, and finally the 



results on upgoing muons reported from the MACRO [TT]] and Baksan |12j experiments. We 
critically discuss the analysis of the various individual data sets. Moreover we consider the 
combined information that can be derived from all the experimental evidences so-far ob- 
tained. We hope this will contribute to a more complete understanding of the atmospheric 
neutrino anomaly in the framework of a global analysis based on a self-consistent theoretical 
calculation of the event rates. This has the advantage of calibrating all relevant elements 
in the analysis, such as theoretical atmospheric neutrino fluxes, in a consistent way. This 
allows different experiments to be compared in a meaningful way. A new element which 
we now add to our previous investigations |T7| is the inclusion of the upgoing muon data 



and the corresponding theoretical flux determinations [|10|-|i2|j. We anticipate that from the 
statistical analysis the — > v T emerges as the oscillation channel which provides the best 
agreement with the combined data. The — > v s channels, although slightly disfavoured, 
cannot be statistically ruled out on the basis of the global fit to the full set of observables. 

The outline of the paper is the following: in Sect. II we briefly recall the theoretical 
calculation of the event rates for contained events and upgoing muon fluxes, as well as the 
calculation of the oscillation probabilities. Sect. Ill discusses the statistical approach of our 
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analysis and reports on the results of the fits. Sect. IV presents a discussion of the results 
and the conclusions. We include more details on the statistical analysis in an Appendix. 



II. ATMOSPHERIC NEUTRINO INDUCED EVENTS IN UNDERGROUND 

DETECTORS 

Atmospheric neutrinos can be detected in underground experiments by direct observation 
of their charged current interaction inside the detector. These are the so-called contained 
events, which can be further classified into fully contained events when the charged lepton 
(either electron or muon) produced by the neutrino interaction does not escape the detector, 
and partially contained muons when the muon, produced inside, leaves the detector. In the 
case of Kamiokande and Super-Kamiokande, the contained data sample is further divided 
into sub-GeV events with visible energy below 1.2 GeV and multi-GeV events when the 
lepton energy is above such cutoff. On the average, sub-GeV events arise from neutrinos of 
several hundreds of MeV while multi-GeV events are originated by neutrinos with energies 
of the order of several GeV. 

Higher energy muon neutrinos and anti-neutrinos can also be detected indirectly by 
observing the muons produced by charged current interactions in the vicinity of the detector. 
These are the so called upgoing muons. Should the muon stop inside the detector, it will be 
classified as a "stopping" muon, while if the muon track crosses the full detector the event 
is classified as a "through-going" muon. Typically stopping muons arise from neutrinos 
of energies around ten GeV while through-going muons are originated by neutrinos with 
energies of the order of hundred GeV. 



A. Contained events 

At present, six underground experiments have collected data on contained events. Three 
of them, Kamiokande 0] 1MB f§] and Super-Kamiokande || use water- Cerenkov detectors, 
while the other three, Frejus 0, NUSEX H and Soudan2 |5],|| are iron calorimeter detectors. 

For a given neutrino conversion mechanism, the expected number of /^-like and e-like 
contained events, N a , a = /i, e can be computed as: 



N„ 



N, 



N e = N ee + N, 



fie i 



(1) 



where 



N, 



a/3 



n t T 



dE u d(cos 6 V \ 



n a (h, cos 6^, E v )P a p——e{Ep)dE v dEpd{cos9 v )dh (2) 
dEa 



and P a /3 is the conversion probability of v a — > i>p for given values of E v ,cos6 y and h, i.e., 
P a p = P{y a — > up; E u , cos 9 u ,h). In the Standard Model (SM), the only non-zero elements 
are the diagonal ones, i.e. P aa = 1 for all a. In Eq.(|2]) n t denotes the number of targets, T 
is the experiment running time, E v is the neutrino energy and § a is the flux of atmospheric 

/i, e for which we use the Bartol flux [IT^ 



neutrinos of type a 



Ep is the final charged lepton 



energy and s(Ep) is the detection efficiency for such charged lepton; a is the neutrino-nucleon 
interaction cross section, and Q v is the angle between the vertical direction and the incoming 
neutrinos (cos 6^=1 corresponds to the down-coming neutrinos). In Eq. (0), h is the slant 
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distance from the production point to the sea level for a-type neutrinos with energy E v and 



zenith angle 9 U . Finally, n a is the slant distance distribution, normalized to one ||20|| . For 
the angular distribution of events we integrate in the corresponding bins for cos 6^ where 
9/3 is the angle of the detected lepton, taking into account the opening angle between the 
neutrino and the charged lepton directions as determined by the kinematics of the neutrino 
interaction. In average the angle between the directions of the final-state lepton and the 
incoming neutrino ranges from 70° at 200 MeV to 20° at 1.5 GeV. 

The neutrino fluxes, in particular in the sub-GeV range, depend on the solar activity. In 
order to take this fact into account, we use in Eq. (0) a linear combination of atmospheric 
neutrino fluxes $™ aa; and $™ m which correspond to the most active Sun (solar maximum) 
and quiet Sun (solar minimum), respectively, with different weights which depend on the 
running period of each experiment ||17|| . Following Ref. jl7| we explicitly verify in our present 
reanalysis the agreement of our predictions with the experimental Monte Carlo predictions, 
leading to a good confidence in the reliability of our results for contained events. 



B. Upward Going Muons 

Several experiments have obtained data on these neutrino induced muons. In our analysis 
we consider the results from three experiments: Super-Kamiokande ||, MACRO fill an d 



Baksan ||12|| . They present their upgoing muon data in the form of measured muon fluxes. We 
obtain the effective muon fluxes for both stopping and through-going muons by convoluting 
the survival probabilities (calculated as in Sect. II. C) with the corresponding muon 
fluxes produced by the neutrino interactions with the Earth. We include the muon energy 



loss during propagation both in the rock and in the detector according to Refs. [^T|,01 an d 
we take into account also the effective detector area for both types of events, stopping and 
through-going. Schematically 

®v{9)s,T - -777 77 / ,„ , —A StT (E ll ,9)dE fl , 

A(L min , 9) JE„ >min dE^d cos 9 



where 



poo poo poo poo 

N A dE^o dE u dX dhK„ (h, cos 9, E u ) 
Je u Je u0 Jo Jo 



dE^d cos 9 Je^ Je^o 

d^(E v ,B) da(E u ,E, ) 

dE u d cos 9 ^ dE, E ^ X ) I 4 ) 

Na is the Avogadro number, E^q is the energy of the muon produced in the neutrino in- 
teraction and En is the muon energy when entering the detector after traveling a distance 
X in the rock. cos# labels both the neutrino and the muon directions which to a very 
good approximation at the relevant energies are collinear. We denote by F roc k(E^ , E^, X) 
the function which characterizes the energy spectrum of the muons arriving the detector. 



Following standard practice [2"T,22"| in our calculations we use the analytical approximation 
obtained by neglecting the fluctuations during muon propagation in the Earth. In this case 
the three quantities E^ , E^, and X are not independent: 



00 



F rock(E^,E„X)dX- {dS {E )/dX ) ' (5) 
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where (dS^(E^) jdX) is the average muon energy loss due to ionization, bremsstrahlung, e + e 
pair production and nuclear interactions in the rock according to Refs. pT| , p2| . Equivalently, 



the pathlength traveled by the muon inside the Super-Kamiokande detector is given by the 
muon range function in water 

In Eq.(||) A(L min , 0) = As{E^ 1) 9) + A T (E fl , 6) is the projected detector area for internal path- 
lengths longer than L m i n which for Super-Kamiokande is L m i n = 7 m. Here As and At 
are the corresponding effective areas for stopping and through-going muon trajectories. For 
Super-Kamiokande we compute these effective areas using the simple geometrical picture 
given in Ref. |23fl. For a given angle, the threshold energy cut for Super-Kamiokande muons 
is obtained by equating Eq.(||) to L min , i.e. L(E^) = L min . 

In contrast with Super-Kamiokande, Baksan and MACRO present their results as muon 
fluxes for > 1 GeV, after correcting for detector acceptances. Therefore in this case we 
compute the expected fluxes as Eqs. (|3]) and ((4|) but without the inclusion of the effective 
areas. 

We have explicitly verified the agreement of our predictions for upgoing muons with the 
experimental Monte Carlo predictions from Super-Kamiokande, Baksan and MACRO. The 
agreement can be observed by comparing our Standard Model predictions for the angular 
distributions in Fig. |6] with the corresponding distributions in Refs. [|T(J and [[□]] . We find 
an agreement to the 5% and 1% level, respectively. 



C. Conversion Probabilities 

For definiteness we assume a two-flavour scenario. The oscillation probabilities are ob- 
tained by solving the Schroedinger evolution equation of the — Vx system in the Earth- 
matter background (in our case, X = r or s). For neutrinos this equation reads: 

& ( Vp \ _ ( Hp H^ x \(v ll 



where 



'dtUwU^ H x )\vx) (?) 



/\ 777 ^ 

H» = V, + —cos26, (8) 



V 



Att? 

H x =V x -jg-co8 26, (9) 
H llX =-^sm26, (10) 



with the following definition of the neutrino potentials in matter 



V s = 0. (12) 
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Here Gp is the Fermi constant, p is the matter density in the Earth, M is the nucleon 
mass, and Y n is the neutron fraction. For anti-neutrinos the signs of potentials Vx should 
be reversed. In the previous Eqs., 9 is the mixing angle between the two mass eigenstate 
neutrinos of masses ni\ and m%. We define Am 2 = m\ — ml in such a way that if Am 2 > 
(Am 2 < 0) the neutrino with largest muon-like component is heavier (lighter) than the one 
with largest X-like component. 

Since for the — > v T case there is no matter effect, the solution of Eq.(|7|) is straightfor- 
ward and the probability takes the well-known vacuum form 

P w = l-sin 2 (20)sin 2 (^). (13) 

where L is the path- length traveled by neutrinos of energy E v . 

In the case of — > u s , the presence of the matter potentials requires a numerical 
solution of the evolution equations in order to obtain the oscillation probabilities P a/ 3, which 
are different for neutrinos and anti- neutrinos because of the reversal of sign of the Vy's. In 
our calculations, for the matter density profile of the Earth we have used the approximate 



analytic parametrization given in Ref. |24| of the PREM model of the Earth ||25|| . Notice that 
for the — > v s case, there are two possibilities depending on the sign of Am 2 . For Am 2 > 
the matter effects enhance neutrino oscillations while depress anti-neutrino oscillations, 
whereas for the other sign (Am 2 < 0) the opposite holds. 

Finally, we have not considered oscillations of z/^'s into electron neutrinos. This possibil- 
ity is nowadays ruled out since z/ M — > v e oscillations cannot describe the measured angular 
dependence of muon-like contained events |17| . Moreover the most favoured range of masses 



and mixings for this channel has already been excluded by the negative results from the 



CHOOZ reactor experiment |26 



III. ATMOSPHERIC NEUTRINO DATA FITS 

In this Section, we describe the fitting procedure we employ in order to determine the at- 
mospheric neutrino parameters sin 2 (26) and Am 2 for the two conversion channels of interest 
and we present our results. 

A. Statistical analysis 

We first notice that we rely on the separate use of the event numbers (not of their ratios), 
paying attention to the correlations between the sources of errors in the muon and electron 
predictions as well as the correlations among the errors of the different energy data samples. 

A detailed description of the steps required in order to determine the allowed regions 



of oscillation parameters was given in Ref. |T7|]. Following Refs. [|T7| , |27| , p8f , we define a 
X 2 -function as 

,,2 X~Y atDATA at th \ i _2 \-l / t\tDATA atTH\ (t A \ 

X = 2^( N I ~ N I r \ DATA + °TH)IJ -{ N J ~ N J ), ( 14 ) 

I,J 

where I and J stand for any combination of experimental data sets and event-types con- 
sidered, i.e, I = (A, a) and J = (B,j3). The latin indexes A, B stand for the different 
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experiments or different data samples in a given experiment. The greek indexes denote 
electron-type or muon-type events, i.e, a,j3 = e,p. In Eq. (|T4|), Nf H stands for the pre- 



dicted number of events (or for the predicted value of the flux, in the case of upgoing muons) 
calculated as discussed in the previous Section, whereas Nf ATA is the corresponding exper- 
imental measurement. In Eq. ([ll]), gIdata an d the error matrices containing the 
experimental and theoretical errors, respectively. They can be written as 

aj J = a a {A)p ot p{A,B)ap{B) 1 (15) 

where p a/ 3(A,B) is the correlation matrix containing all the correlations between the a-like 
events in the A-type experiment and /3-like events in 5-type experiment, whereas u a {A) 
and (T 13(B) are the errors for the number of a and /3-like events in A and B experiments, 
respectively. The dimensionality of the error matrix varies depending on the combination 
of experiments included in the analysis. 



We have computed the correlation matrix p a p(A, B) as described in Ref. [27|. In the case 
of contained events, a detailed discussion of the errors and correlations used in our analysis 
can be found in Ref. [171 , which, for the sake of clarity and completeness, we summarize in 



the Appendix. In the same Appendix, we include the discussion of the errors and correlations 
employed for the upgoing muon data analysis. 

With all the definitions discussed above, we can calculate the x 2 i n Eq. (fUD as a func- 
tion of the neutrino parameters. By minimization of the x 2 with respect to sin 2 (2$) and 
Am 2 , we determine our best fit results, while the allowed regions are determined by the 
following conditions: x 2 = Xmin + 4 -61 (6.1) [9.21] for a confidence level (CL) of 90 (95) [99] 
%, respectively. 

The data sets employed in the statistical analysis are the following: (i) Frejus 0, Nusex 
||, 1MB M and Soudan2 || data sets, which refer to low-energy, contained events. For 
each experiment, the total rate for e-like and for /z-like events is reported. We jointly 
analyze these data (and hereafter we collectively denote them as FISN) ; (ii) e-like and //-like 
Kamiokande data [0] , including the sub-GeV event rate and a 5-bin zenith-angle distribution 
for the multi-GeV data; (iii) Super-Kamiokande data jl(|, again comprising e-like and //-like 
contained events, arranged into sub-GeV and multi-GeV samples, each of which given as a 
5-bin zenith-angle distribution; and the up-going data including the stopping muon flux (5 
bins in zenith-angle) and the through-going muon flux (10 angular bins); (iv) MACRO JTTJ] 
and Baksan Jl2| upgoing muons samples, each one with 10 angular bins. 

In the discussion of our results, along with presenting the results of the separate analyses 
of the single data sets, we analyze various possible combinations of data samples in order to 
develop an understanding of the relevance of the different sets of data, which, we recall, refer 
to events characterized by different properties. For instance, contained events are produced 
by neutrinos of relatively low energies (below a few GeV), while the upgoing muon fluxes 
are originated by neutrinos whose energies cover a much wider range, from a few GeV to 
hundreds of GeV. This feature, combined also with the angular distributions, allows one to 
test the energy dependence of the oscillation probabilities in the different channels. 



B. Results of the analysis 

As a first result of our analysis, we show the (in) consistency of the data with the Standard 
Model hypothesis. The first column of Table | reports the values of the x 2 function in 
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the absence of new physics, as obtained with our prescriptions and calculated for different 
combinations of atmospheric data sets. We notice that all the data sets clearly indicate 
deviation from the standard model. The global analysis, which refers to the full combination 
of all data sets, gives a value of X5M,giobai = 214/(75 d.o.f ) corresponding to a CL of 3 x 10~ 15 . 
This indicates that the Standard Model can be safely ruled out. Instead, the x 2 f° r the global 
analysis decreases to Xmin = 74/(73 d.o.f) (45 % CL) when assuming the — > v T oscillation 
hypothesis. 

Table | reports the minimum values of \ 2 an d the resulting best fit points for the var- 
ious oscillation channels and data sets considered. The corresponding allowed regions for 
the oscillation parameters at 90, 95 and 99 % CL are depicted in Figs. [I], ||, £|, | and [7|. 
The zenith-angle distributions referring to the Super-Kamiokande data and to the upgoing 
muon measurements of MACRO and Baksan are plotted in Figs. [|, |] and || Note that no 
uncertainties are shown in the plots for the theoretical predictions, while experimental data 
errors are explicitly displayed. We now turn to the discussion of the main results. 

1. Contained Events 

The allowed regions for contained events are displayed in Figs. [1] and |3|. In all figures 
the best fit points are marked with a star and can be read from Table | together with the 
corresponding value of the Xmm f° r eacri case. 

In the first column of Fig. [I] we show the results for the combination of the "unbinned" 
FISN data, i.e. the total rates from the Frejus, 1MB, Nusex and Soudan experiments. Since 
no angular information in present in this case, no lower limit on the oscillation length can be 
derived and the regions extend to arbitrary large mass differences. We notice, from Table |, 
that the best fit results, although definitely improved with respect to the SM case, do not 
show, for each oscillation channel, a CL better than 4%. We remind that the FISN data 
sample contains the Frejus and Nusex data, which are by themselves compatible with the 
SM. This fact plays a role in maintaining a relatively high \ 2 even in the oscillation cases. 

The second column of Fig. [I] corresponds to the combination of contained sub-GeV 
(unbinned) and multi-GeV (including the angular dependence) data from the Kamiokande 
experiment. In this case, the angular distribution of the multi-GeV events plays an important 
role in determining an upper limit for Am 2 , for a given value of the mixing angle. The region 
which is obtained overlaps with the previous one from the FISN data sample, and indicates 
a preference for values of Am 2 > for all the oscillation channels. For the Kamiokande 
data, the agreement with the oscillation hypothesis is at the level of ~ 70% CL. 

Finally, in the third column of Fig. |l] we plot the allowed regions for the combination 
of the angular distributions of the sub-GeV and multi-GeV 52 kton-yr Super-Kamiokande 
data. The best fit for the — > v T hypothesis has a very high confidence level: Xmin = 8.9/(18 
d.o.f.), which translates into 96% CL, substantially improved with respect to the Kamiokande 
data sets. In the case of oscillation to sterile neutrinos, the CL is 79%, slightly higher than 
for the Kamiokande data alone. The angular distributions of the Super-Kamiokande sub- 
GeV and multi-GeV /i-like events are shown in Fig. |^. We also show in the figure the 
e-like distributions to illustrate that they do no show any evidence of deviation from the 
standard model prediction. The agreement of the e-like distributions with the expectations 
from the standard model has become more tight as the Super-Kamiokande collaboration has 
been increasing their data sample. This has translated into an overall improvement of the 
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CL for the oscillation hypothesis into channels not involving electron neutrinos. Conversely 
solutions involving oscillations into electron neutrinos have become more disfavoured |28],|3l| . 

From Fig. ||] one sees that there is a strong evidence of a depletion in the event rates with 
respect to the SM expectation. We notice that the zenith-angle distributions obtained with 
the best-fit neutrino parameters are able to reproduce the data to a high level of agreement. 

From Fig. [TJ, one can notice that in all the — > v s channels where matter effects play a 
role, the range of acceptable Am 2 is slightly shifted towards larger values, when compared 
with the Vfi —>■ v T case. This follows from looking at the relation between mixing in vacuo 
and in matter. In fact, away from the resonance region, independently of the sign of the 
matter potential, there is a suppression of the mixing inside the Earth. As a result, there is 
a lower cut in the allowed Am 2 value, and this lies higher than what is obtained in the case 
of the Up — > v T channel. Also, for the — > v s case with Am 2 > the matter effects enhance 
neutrino oscillations while depress anti-neutrino oscillations. Since atmospheric fluxes are 
dominantly neutrinos, smaller mixing angle values can lead to the same suppression and 
the region extends to smaller mixing angles in the Am 2 region where the matter effects 
are important for the relevant neutrino energies. The opposite holds for Am 2 < 0. In this 
case the matter effects depress neutrino oscillations, and therefore larger mixing angles are 
needed to account for the observed deficit. As a consequence, the allowed regions become 
smaller (in angle) for this channel. 

When comparing our results with the corresponding analysis presented by the Super- 
Kamiokande Collaboration on their data sets, we find good agreement on the allowed param- 
eters although in general our regions are slightly larger. We also find that, for the — ► v T 
channel, the allowed regions for the contained events are shifted towards slightly lower Am 2 
values with respect to Super-Kamiokande analysis. We have traced this difference back 
to the sub-GeV sample and to our use of different neutrino fluxes. Notice that sub-GeV 
events are most sensitive to details in the neutrino fluxes from the different calculations, 



such as the modeling of the geo-magnetic cut-off [29]. The expected angular distribution in 



the absence of oscillations from the Super-Kamiokande Monte-Carlo using Honda fluxes is 
slightly "flatter" then our calculations for the sub-GeV event distributions. We have verified 
that if we normalize our results to the Super-Kamiokande Monte-Carlo predictions, then 
the allowed region we obtain is shifted to slightly larger Am 2 values in agreement with the 
Super-Kamiokande analysis. 

Finally, the global analysis of the combination of all the above data sets is shown in 
the first column of Fig. (notice a change of scale between this figure and Fig. [I]). The 
allowed regions, as well as the best fit points, are clearly driven by the high statistics 
Super-Kamiokande data. The results show, as expected from the above discussion, that 
the — > u T case prefers slightly lower values of Am 2 (from a few 10~ 4 to a few 10~ 3 eV 2 ) 
when compared to the — > v s cases, where values in excess of 10~ 3 eV 2 are obtained. In all 
the cases, almost-maximal mixing is statistically preferred. Concerning the quality of the 
fits, as seen in Table |jj in the full combination the z/ M — > v T channel gives a slightly better 
fit (Xmin = 37/38) than — > v s (Xmin = 40/38) although the difference is not statistically 
significant (51% CL versus 38% CL). 
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2. Upward Going Muons 



Our results for the allowed regions for upgoing muon events are displayed in Figs. £| for 
the Super-Kamiokande data on stopping and through-going muons and in Fig. |5| for the 
MACRO and Baksan experiments. The global analysis on all the data samples on upgoing 
muons is shown in the second column of Fig. [3]. 

From the analysis of Super-Kamiokande data on stopping muons we find that the \ 2 ~ 
function is substantially flat for Am 2 values above 10~ 3 eV 2 and sin 2 (26 l ) ^0.5 and therefore 
the allowed regions are open from above, also at 90 % CL. This is a consequence of the 
fact that the stopping muons data sample by its own is consistent with a global reduction 
of the neutrino flux with no specific angular dependence. This feature can be observed by 
comparing the angular distribution of the data points in the first panel of Fig. |6] and the 
corresponding prediction in the absence of oscillations. This behaviour is what is expected 
from oscillations with short oscillation lengths (high Am 2 ). 

In contrast, the through-going Super-Kamiokande muon sample indicates a somewhat 
angular-dependent suppression. The second panel of Fig. ^| shows that the reduction is 
clearly larger for vertically-coming muons than for those arriving from the horizon. As a 
consequence, the corresponding allowed regions turn out to be closed from above, i.e. for 
large Am 2 . This is plotted in the second column of Fig. |], whose comparison with the 
first column shows the general agreement between the stopping and through-going muons 
data samples. This is an interesting property in favour of the neutrino oscillation hypothesis, 
since, as noted before, stopping and through-going muon events originate from very different 
parent-neutrino energies. 

Finally, the combination of both stopping and thru-going muon events in Super- 
Kamiokande is shown in the third column of Fig. f|. We find a very good agreement between 
our results and the corresponding ones given by the Super-Kamiokande Collaboration. The 
best fit points in ours and the Super-Kamiokande analyses are very similar, although also 
in this case our regions are slightly larger. From the angular distributions of Fig. ([J), we 
can observe that due to matter effects the distribution for upgoing muons in the case of 



v s are flatter than for — > v T |30],|23[ . Since the data show a somehow steeper angular 
dependence, a better description in terms of — > v T oscillations is found. From Table |, we 
see that the upward going muon fit in this channel is indeed better, although the statistical 
preference of this channel over the sterile case (45% CL for — > v T as compared to about 
30% CL for — > v s ) is not overwhelming. 

In the case of both MACRO and Baksan experiments we generally find a less significant 
statistical agreement between the data and the theoretical evaluations. Both data sets are 
clearly inconsistent with the SM predictions, as indicated by their high Xsm values in Table 
|: the CL are 7 x 10~ 4 for MACRO and 5 x 10~ 3 for Baksan. However, the quality of the 
fits does not strongly improve when interpreted in terms of neutrino oscillations. We find 
that the best agreement occurs for the oscillation in the — + v T channel for the MACRO 
experiment. In this case we obtain a 5% CL and an allowed region in the parameter space, 
which is shown in the first panel of Fig. [|. This result is fully consistent with the analysis 
performed by the MACRO Collaboration on their data set [fTT|| . We notice that, as can be 
seen from the angular distribution of Fig. ||, the flux in the fourth bin (—0.7 < cos 6 Z < —0.6) 
is at least 2-a above the expectation in the presence of oscillations. When removing this 
point from the statistical analysis, the quality of the fit for the — > v T oscillation channel 
improves to 19% CL, while affecting very little the allowed region. In contrast, for the sterile 
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cases, we encounter a very low statistical confidence (about 1% CL), even after removing the 
fourth bin data point. As a result the corresponding allowed oscillation parameter regions 
are not very meaningful, since the best fit point has a large Xmin value. For this reason we 
have not reproduced them here. We only comment that the x 2 is very flat in the neutrino 
oscillation parameters, without a clear indication of a statistically preferred region. In the 
Am 2 > case, two almost degenerate minima are found, one for small and one for large 
mixing angle, as can be seen in Table |). 

For Baksan we find no clear preference for the oscillation hypothesis with respect to the 
Standard Model case, although in the sterile channels the best fits with oscillation turn out 
to be slightly better than for the no-oscillation case. We reproduce in Fig. ||] the allowed 
region for the — *> v s (Am 2 > 0) case, which is the one with lowest \ 2 . In the case of 

— > v T and — > v s (Am 2 < 0), the allowed regions are very similar to the one depicted in 
Fig. |5|. We wish to warn that, due to the low statistical significance of the best fit results, 
these regions should be taken only as indicative. 

To conclude this Section, we show in the right column of Fig. ^ the result of our analysis 
for the combination of all the data on upgoing muons discussed above. In the case of 

— > u T , one notices that the Super-Kamiokande and MACRO results give consistent and 
similar allowed regions, while Baksan gives compatible but not strongly constraining results. 
As a consequence, the combined analysis gives a region which is intermediate to the Super- 
Kamiokande and MACRO ones. The best fits of the combined upgoing neutrino analysis 
have a low CL (around 1% for all the oscillation channels), a result which is mainly driven 
by the high Xmm values of MACRO and Baksan (we recall that Super-Kamiokande upgoing- 
muon data alone indicate a preference for neutrino oscillation at a level always better than 
25%). However, the global analysis of the upgoing muons data disfavours the Standard 
Model at the 3 x 10" 5 level. 

3. Global Analysis 

Let us now move to the discussion of the comparison and combination of contained events 
with upgoing muons fluxes. We observe from Fig. |3] that the allowed regions obtained from 
both types of analyses are fully consistent between themselves for all the oscillation channels. 
For the cases of — *> v s the allowed region for the contained events lies always inside the 
corresponding regions allowed by the upgoing muon analysis. For the — > v T channel, we 
find that the region for contained events extends to lower values of Am 2 , when compared to 
the region for upgoing muons. 

In figure |7] we display the allowed regions after combining together contained and upward 
going muon data. In the first column we show the results when only including the Super- 
Kamiokande data. The second column shows the corresponding results when data from all 
experiments are included, while in the third column we show the allowed regions when only 
the results from experiments observing some evidence of neutrino oscillation are included. 
The general behaviour is that when including the results from all experiments the regions 
become slightly larger than those obtained from the analysis of the Super-Kamiokande data 
alone. On the other hand, as expected, the results become more restrictive when only the 
data from experiments observing some evidence for oscillations are included. In Table | we 
list the values of the best fit points for the various cases. 

Our results from the combined analysis show that the channel — > v T gives a better 
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fit to the data than oscillations into sterile neutrinos. The difference for the global analysis 
is x ^. n = 74/(73 d.o.f.) (45 % CL) for the active case versus xLn = 90/(73 d.o.f.) (8.5 
% CL) for oscillations into sterile neutrinos with Am 2 < and Xmin = 86/(73 d.o.f.) (14 
% CL) for — > v s with Am 2 > 0. This difference in the quality of the description is still 
maintained when some of the negative-result experiments are excluded from the analysis (by 
"negative-result experiments" we mean experiments which, from our statistical analysis, do 
not give a clear evidence of neutrino oscillation, i.e. have relatively high Xmin values). All of 
these features can be seen in Table |I[ When removing from the analysis the Frejus, Nusex 
and Baksan data points, we do not obtain an improvement for the sterile cases, while for 
the active case the CL is increased to 58 % (x m in = 58/(61 d.o.f.)). When also MACRO is 
removed, we obtain higher CL also for the sterile cases, but the — > v T hypothesis remains 
as the best option: Xmin = 41/(51 d.o.f.) (84 % CL) for the active case, Xmin = 51/(51 
d.o.f.) (47 % CL) for v„ -> v s with Am 2 < and xLn = 50/(51 d.o.f.) (51 % CL) for 
— > v s with Am 2 > 0. 

In conclusion, we find that the quality of the global description is better for the — > v T 
channel although oscillations into — > v s cannot be statistically ruled out on the basis of the 
global fit to the full set of observables. In Fig. ^ we show the zenith-angle distributions for 
the Super-Kamiokande data sets, calculated for the best-fit points obtained in the global 
analysis of the data, when only "positive results" experiments are considered. From the 
figure, we notice that the v a —>■ v s cases have more difficulties in reproducing the distribution 
of the data points because for — > v s the survival probability of muon-neutrinos has a less 
steep angular behaviour as compared with the v u — > v T case due to the Earth matter effects 
present in the — > v s channels. 

IV. DISCUSSION 

In this paper we have performed a global analysis of the atmospheric neutrino data in 
terms of neutrino oscillations. We have compared the relative statistical relevance of the 
active-active and active-sterile channels as potential explanations of the atmospheric neu- 
trino anomaly. In the analysis we have included, for the contained events, the latest data 
from Super-Kamiokande, corresponding to 52 kton-yr, together with all other available at- 
mospheric neutrino data in the sub-GeV and multi-GeV range. Specifically, we included the 
data sets of the Frejus, Nusex, 1MB, Soudan2 and Kamiokande experiments. Our analysis 
also includes the results on neutrino induced upgoing muons from the Super-Kamiokande 
52 kton-yr sample, from MACRO and from Baksan experiments. We have determined the 
best-fit neutrino oscillation parameters and the resulting allowed regions in sin 2 (26 l ) and 
Am 2 for i/p — > Vx (A = r, s) channels. For oscillations into sterile neutrinos we have con- 
sidered both positive and negative Am 2 , since the two cases differ in the matter effect for 
neutrinos propagation in the Earth. 

The results of the combined analysis indicate that the channel — > v T gives a better fit 
to the data than oscillations into sterile neutrinos: Xmin = 74/(73 d.o.f.) (45 % CL) for the 
active case versus Xmin = 90/ (73 d.o.f.) (8.5 % CL) for oscillations into sterile neutrinos with 
Am 2 < and x m in = 86/(73 d.o.f.) (14 % CL) for v a -> v s with Am 2 > 0. Since for some 
experiments we obtain large Xmin values also for neutrino oscillations, values not clearly 
better than the analysis for the standard model case, we decided to perform additional 
analyses by removing these "negative-result experiments". When excluding Frejus, Nusex 
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and Baksan data points, we do not obtain an improvement for the sterile cases, while for 
the active case the CL is increased to 58 % (Xmin = 58/(61 d.o.f.)). When also MACRO is 
removed, we obtain higher CL also for the sterile cases, but the — *> v T hypothesis remains 
as the best option: Xmin = 41/(51 d.o.f.) (84 % CL) for the active case, Xmin = 51/(51 
d.o.f.) (47 % CL) for V(t -> v. with Am 2 < and xLn = 50/(51 d.o.f.) (51 % CL) for 

— > y s with Am 2 > 0. We thus conclude that the quality of the global description of the 
atmospheric neutrino data in terms of neutrino oscillation is better for the v ^ — > v T channel, 
although oscillations into — > v s cannot be statistically ruled out, on the basis of the global 
fit to the full set of observables. 

We have also presented a sample of predicted zenith-angle distributions for the best-fit 
points corresponding to the various oscillation channels. Specifically, we showed the angular 
distribution corresponding to the four Super-Kamiokande data sets (sub-GeV, multi-GeV, 
stopping muons and through-going muons) and the angular distributions for upgoing muons 
at MACRO and Baksan. By using the zenith-angle distribution expected for contained 
events and up-going muon data at Super-Kamiokande in the presence of oscillations, we 
have compared the relative goodness of the three possible oscillation channels. This allowed 
one to understand why the — > u T channel gives a better description than the — > v s 
cases. On the one hand, due to matter effects, one finds that for the sterile case the up-down 
asymmetry in the multi-GeV sample is slightly smaller than observed. Moreover, also due 
to matter effects, the upgoing-muon distributions in the case of — > v s are flatter than for 

— > u T , while the data show a slightly steeper angular dependence which can be better 
described by — ► v r . 

To conclude, we compare our determinations of the allowed neutrino oscillation param- 
eters from the analyses of the atmospheric neutrino data with the expected sensitivities of 
future long-baseline experiments such as K2K and MINOS |33| (Fig. [F|). We notice that, 
for the oscillations — > u T , K2K can cover most of the 90% CL allowed region while the 
MINOS test of NC/CC is sensitive to the complete 99% CL region of oscillation parameters. 
For oscillations into sterile neutrinos, a situation where only a CC disappearance test can 
be performed at long baseline experiments, K2K can cover a portion of the region allowed 
at 90% CL, while the full 99% CL allowed regions are completely accessible to the MINOS 
experiment. 



APPENDIX: STATISTICAL ANALYSIS 

In this Appendix, we discuss the errors and correlations employed in our analysis. 



A. Errors 

Data errors contain the experimental statistical and systematic errors as well as the 
uncertainties arising from event mis-identification, as quoted by the experimental Collab- 
orations. In the theoretical calculations of event rates and upgoing muon fluxes, we take 
into account the uncertainty in the atmospheric neutrino flux and the uncertainties in the 
charged- current neutrino cross-sections [p7[| . We also include, the Monte Carlo (MC) sta- 



tistical errors estimated by the experimental Collaborations with the simulations of their 
detectors. This uncertainty depends on the number of simulated Monte-Carlo events. 
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The flux uncertainty is taken to be 30% at lower energies, relevant for contained events, 
and 20% at higher energies, characteristic of upward going muons. Nuclear cross-section 
uncertainties are taken to be 10% for all the contained event samples, except for Soudan2 
for which we used the values 7.5% and 6.4% for e-like and //-like events, respectively 
For stopping and through-going muons, as cross-section uncertainties we use 11.4% and 14.1 
%, respectively |J. The Monte-Carlo statistical errors are estimated from the simulated 
exposure, as given by the experimental Collaborations, under the assumption that the fr- 
aud /i-like contained events follow a binomial distribution. 



B. Correlations 

There is a large number of correlations, both from experimental and from theoretical 
sources. In our analysis, data errors between different experiments are assumed to be un- 
correlated, i.e. 

Paa TA (A, A) = 1 (a = e, p) for all data samples (16) 
p^ ATA (A,B) = 0(a,f3 = e,p) if A ? B, 

while the correlations in the theoretical quantities referring to different experiments (i.e., 
for A ^ B) are assumed to arise from the correlations amongst the theoretical errors for 
the neutrino flux normalization and amongst the theoretical uncertainties of the neutrino 
interaction cross section. 

In order to determine the different entries, we have classified the experiments in four 
samples: 

• sub-GeV (SG): Frejus, 1MB, Nusex, Soudan2, Kam sub-GeV 

and Super-Kam sub-GeV 

• multi-GeV (MG): Kam multi-GeV and Super-Kam multi-GeV 

• stopping muons (STOP): Super-Kam 

• thru-going muons (THRU): Super-Kam, MACRO and Soudan. 
We then estimate the correlations as follows, 

Pap [A, B) - Pap {A, B) X a TH {B) + Pap I A >< a TH {A) a TH 

where the correlation p^ x and p^S ss can be computed from the allowed uncertainties on 
the corresponding ratios by means of: 

a%{A : a, B : (5) = a 2 ( = a 2 J lux {A) + a 2 / l ™(B) - 2p^(A, B)a^(A)a f ^(B) 
a 2 Rc (A :a,B:!3) = a" (fg^g) = a 2cross (A) + a 2 ™ s (B) - 2p™ s (A, B)aZ° ss (A)a^(B) 

We assume that the errors in the above defined ratios of the neutrino fluxes and the neu- 
trino cross-sections between the different experiments arise from three sources: the flavour 



dependence, the energy dependence and the angular dependence [2e 



a 2 Rf (A :a t B:0) = <r 2 RfJlav (A :a,B:(3) + a Rf>en + (A : a, B : (3) + a 2 ang {A :a,B:(3) 
a 2 Rc (A :a,B:P) = <J 2 RcJlav (A :a,B:(3) + a 2 Rc , en (A :a,B:(3) + a 2 ang (A xa,B\0) 
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For sub-GeV data samples, there are additional sources of uncertainties with respect to 
the other data sets. For instance, the form of the geo-magnetic cut-off used in the neutrino 
flux, the nuclear modeling for the neutrino interaction cross section, the neutrino production 
in the atmosphere. These additional uncertainties allow a large variation of the expectations 
for sub-GeV experiments, without affecting the predictions for higher energy events. Thus 
we neglect the correlations in the theoretical errors between sub-GeV events and any of 
the higher energy samples. Moreover the different experimental collaborations use different 
calculations for the neutrino interaction cross section, thus we neglect correlations between 
the r$theoretical errors of the interaction cross sections for different detectors. For all other 



cases we use the followin 
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a lng( A '■ ca, B : P) — 5%| cos(^a) — cos(#b)| for all angular distributions 

With this we get that the smallest non- vanishing theoretical correlation within the Super- 
Kamiokande samples occurs between the theoretical errors for most vertical multi-GeV elec- 
tron bin and the most horizontal thru-going muon bin and it takes the value p TH = 0.735 
while, for example, the correlation between the theoretical errors of the two most horizontal 
bins of the thru-going muon sample is p TH = 0.989. 
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8 


Contained comb 


103 


0.99 


1.0 


0.97 


1.7 


2.7 


2.6 


37 


40 


40 


38 


Upgoing fi comb 


76 


0.99 


1.0 


0.97 


3.0 


3.0 


4.6 


56 


60 


59 


33 


Global 


214 


0.92 


1.0 


0.85 


2.6 


3.0 


4.0 


74 


90 


86 


73 


Global* 


182 


1.0 


1.0 


0.95 


3.0 


3.0 


4.0 


58 


76 


75 


61 


Global** 


156 


0.99 


1.0 


0.96 


3.0 


4.0 


4.0 


41 


51 


50 


51 



TABLE I. Minimum \ 2 values and best-fit points for the various data sets and oscillation 
channels. For the —>■ v s channels, we have denoted by (— ) the case with Am 2 < and by (+) 
the case with Am 2 > 0. Global refers to the best-fit for the global analysis which includes all the 
data sets listed above. Global* includes all the data sets, except for Frejus, Nusex and Baksan. 
Global** includes all the data sets, except for Frejus, Nusex, Baksan and MACRO. For the sake 
of comparison we also list the Xsm expected in the absence of oscillations. Notice that for the 
MACRO data set, for the — > v s channel (Am 2 > 0) we find two almost degenerate minima. 
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FIG. 1. Allowed regions in the sin 2 (2#) - Am 2 parameter space for different combinations of 
contained events and for the different oscillation channels. The shaded areas refer to the 90% CL, 
while the inner (outer) lines stand for 95% (99%) CL, respectively. FISN labels the combined rates 
from Frejus, 1MB, Soudan2 and Nusex experiments. For each panel, the best fit point is marked 
with a star. 
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FIG. 2. Zenith-angle distributions for the Super-Kamiokande electron-like and muon-likc 
sub-GeV and multi-GeV events, together with our prediction in the absence of oscillation (thick 
solid line) and the predictions for the best fit points for each data set in the different oscillation 
channels: — > v T (thin solid line) and — > v s (dotted line). Since the best-fit point occurs 
for maximal mixing, the histograms for i/„ — ► v s are independent of the Am 2 sign. The errors 
displayed in the experimental points are statistical. 
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FIG. 3. Allowed regions in the sin 2 (26) - Am 2 parameter space for the combination of all 
contained event data (left panels) and the combination of the upgoing muon data (right panels). 
Notations are as in Fig. 1. 
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FIG. 4. Allowed regions in the sin 2 (26) - Am 2 parameter space for the Super-Kamiokande 
data on upgoing muons. Notations are as in Fig. 1. 
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FIG. 5. Allowed regions in the sin 2 (26) - Am 2 parameter space for the MACRO and Baksan 
data. The cases which provide the best agreement with the data are presented: — > ^ r for 
MACRO and Un — ► with Am 2 > for Baksan. Notations are as in Fig. 1. 
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FIG. 6. Zenith-angle distributions for upward-going muon events in Super-Kamiokande, 
MACRO and Baksan, together with our prediction in the absence of oscillation (thick solid line) as 
well as the predictions for the best fit points for each data set. The different lines refer to: — ► v T 
(thin solid line), — > v s with Am 2 < (dotted line), and — > v s with Am 2 > (dashed line). 
The errors displayed in the experimental points are statistical. 
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FIG. 7. Allowed regions in the sin 2 (29) - Am 2 parameter space for the full combination of 
Super-Kamiokande event data (left panels), the full data sample from all atmospheric neutrino ex- 
periments (central panels) and the combination of positive result atmospheric neutrino experiments 
(right panels). The shaded areas refer to the 90% CL, while the inner (outer) lines stand for 95% 
(99%) CL, respectively and the best fit points are indicated by a star. With Global* we indicate 
that all the data sets are included, except for Frejus, Nusex and Baksan. Global** includes all 
the data sets, except for Frejus, Nusex, Baksan and MACRO. Expected sensitivities of the future 
long-baseline experiments K2K and MINOS are also displayed for each oscillation channel. 
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FIG. 8. Zenith-angle distributions for the Super-Kamiokande data sets, together with our 
prediction in the absence of oscillation (thick solid line) as well as the predictions for the best fit 
points obtained in the global analysis of the data (denoted as Global** in Table |). The different 
lines refer to the various oscillation channels: Vn —* v T (thin solid line), z/« —* u s with Am 2 < 



(dotted line), and f M 
points are statistical. 



u s with Am > (dashed line). The errors displayed in the experimental 
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